IMAGE INPUT APPARATUS 
AND IMAGE INPUT METHOD 



FIELD OF THE INVENTION 

The present invention relates to image input 
apparatuses such as digital cameras or non contact type handy 
scanners and image input method. More particularly, this 
invention relates to the image input apparatus and image 
input method which can pick up partial images at such timing 
that the amount of overlap among the partial images is 
properly, and then composes the partial images into one 
image . 

BACKGROUND OF THE INVENTION 

Recently, in the portable information terminals , there 
have been ever increasing demands for inputting various 
documents, especially in the mobile computer environments. 
These documents vary in a wide range including A 4 size to 
those sizes wider than this. In an attempt to achieve these 
demands, conventional flat bed scanners have problems in 
which it is difficult to carry these and it is also impossible 
to input the paper face of a document having a large size. 
In order to solve these problems, for example, Japanese 
Patent Application Laid-Open No. 11-73494 has proposed the 
following method. In this method, a scanning process is 
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carried out with the input apparatus made in contact with 
the document, and the document image is acquired as a 
plurality of partial images so that these are composed later 
to reproduce the document image. However, the action 
(operation) for carrying out the scanning with the apparatus 
made in contact with the paper face is inferior in operability , 
resulting in a problem of a long input time. 

Recently digital cameras are utilized as portable type 
scanners. Such a technique has been disclosed by, for 
example, Japanese Patent Application Laid-Open No . 11-98485. 
In this method, an input apparatus is placed on the document 
side, and the input apparatus is allowed to pick up an image 
of the document, and a distortion due to the image pickup 
operation, in particular, in a diagonal direction is 
eliminated. However, problems with this image input 
apparatus disclosed by this Patent Publication are that the 
resolution in the input image tends to become insufficient 
as a whole and that the resolution tends to vary depending 
on portions thereof located in front the input apparatus 
and those portions located apart from the input apparatus. 

Along with the development of digital image pickup 
apparatuses with high resolution, the number of pixels in 
a CCD image pickup element has been remarkably improved; 
however, these are still insufficient in picking up fine 
characters and patterns with good reproducibility. 



Therefore, a process has been proposed in which each portion 
of an image pickup subject is picked up as a partial image, 
and these partial images are composed so that an image that 
looks as if it were taken by using an image pickup element 
5 having pixels with high density, with a wide angle. When 
an image with high precision is generated by using this 
composing technique of these partial images, the following 
points need to be taken into consideration. 

More specifically, each of the partial images requires 
10 an overlapping area with respect to the adjacent partial 
image. The composing process for the respective partial 
images is carried out based upon image information on this 
overlapping area. In general, the greater the overlapping 
area, the higher the precision in the image composing process . 
15 However, on the other hand, there is an increase in the number 
of partial images to be picked up, and consequently, an 
increased processing time in the image composing process. 

In this manner, when these partial images are picked 
up, it is necessary to pick up images so as to maintain 
20 overlapping areas with a proper number of images . However, 
such an operation imposes considerable skills and errors 
on the photographer ' s side. In order to solve these problems , 
for example, Japanese Patent Application Laid-Open No. 
7-107379 has proposed "a still image pickup apparatus' 7 . In 
25 Figures, reference number 1 represents an image pickup 
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section for picking up an image from each portion of an image 
pickup subject, and for successively outputting the 
resulting image data, reference number 2 represents a pickup 
position orientation measuring section for measuring the 
position and orientation of the image pickup section 1, and 
for outputting position orientation information, reference 
number 3 represents an image selection section for finding 
the range of each image to be picked up on the image pickup 
subject based upon the image data and the image pickup range 
information successively sent from the image pick up section 
1 as well as based upon the position orientation information 
sent from the pickup position orientation measuring section 
2, and reference number 4 is an inner memory in which image 
previously picked up are stored. 

In this still image pickup apparatus, the input 
apparatus is held by the hand on a document, and the image 
pickup face is mechanically shifted so that, at each position, 
each partial image is automatically picked up by the image 
pickup face in a manner so as to have overlapping areas. 
However, it is not possible to input the paper face of large 
size paper, and it is necessary to take into consideration 
influences from the hand shaking, with the result that the 
overlapping areas are taken in an excessive manner, 

Japanese Patent Application Laid-Open No. 9-261520 
discloses an image input apparatus which canpickup apartial 



image with a proper amount of overlap being maintained, while 
a scanning process is carried out over a document by the 
hand in a non contact manner. As illustrated in Fig. 20, 
in this arrangement, the position orientation of the input 
apparatus (pickup section 1) is measured, and based upon 
measuring information related to the position orientation, 
the current image pickup range on the document is calculated, 
and based upon the results of the calculations, the amount 
of overlap over the previously picked up image is estimated 
so that it is possible to carry out an image acquiring 
operation at the time when an appropriate amount of overlap 
has been obtained during the scanning process. Moreover, 
in this case, the size of the overlapping area is determined 
depending on the pattern matching (mutual correlation) 
between the two images in the input images. 

However, the problem with the above mentioned 
conventional image input apparatus as described in Japanese 
Patent Application Laid-Open No. 9-261520 is that the 
orientation angles and positions of the input apparatus with 
6 degrees of freedom with respect to a subject need to be 
detected, with the result that the apparatus becomes bulky 
and expensive in order to carry out these detections, 
resulting in an expensive apparatus; therefore, this method 
is not suitable for a practical use. 

Moreover, the size of the overlapping area is 



determined by using pattern matching from an input image; 
however, in order to achieve this process, it is necessary 
to input image at high speeds, with the result that a very 
expensive image pickup element is required and the apparatus 
5 is limited in the usable environments. 

SUMMARY OF THE INVENTION 

It is an object of this invention to provide a small 
sized, inexpensive image input apparatus and image input 
10 method which can detect a change in picked up images between 
a partial image previously picked up and a current partial 
image by using a simple structure, and which can properly 
maintain the amount of overlap of the partial images required 
at the time of image composition. 
15 The image input apparatus according to one aspect of 

the present invention comprises an image pickup unit which 
optically scans a subject and thereby successively acquires 
plural images of the subject that are partial images of the 
subject having overlapping portions, wherein the image 
20 pickup unit obtains the partial images by moving in a plane 
that is parallel to a plane of the sub j ect and without touching 
the subject; a relative change detection unit which detects 
an amount of relative change in position or speed of the 
image pickup unit between a time when a previous partial 
25 image was taken and a time when a current partial image is 
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being taken; an overlapping amount calculating unit which 
calculates an amount of overlap between the previous partial 
image and the current partial image based upon the amount 
of relative change in position or speed detected by the 
relative change detection unit; and an image recording 
determination unit which determines whether or not the 
current partial image is to be recorded based upon the amount 
of overlap calculated by the overlapping amount calculating 
unit ♦ 

The image input apparatus according to another aspect 
of the present invention comprises an image pickup unit which 
optically scans a subject and thereby successively acquires 
plural images of the subject that are partial images of the 
subject having overlapping portions, wherein the image 
pickup unit obtains the partial images by moving in a plane 
that is parallel to a plane of the subj ect and without touching 
the subject; an angle detection unit which detects a change 
in angle of the image pickup unit based upon rotation angular 
velocities around two axes that are virtually parallel with 
an optic axis of said image pickup unit and mutually 
perpendicular to each to other between a time when a previous 
partial image was taken and a time when a current partial 
image is being taken; an overlapping amount calculating unit 
which calculates an amount of overlap between the previous 
partial image and the current partial image based upon the 



change in angles detected by the angle detection unit; and 
an image recording determination unit which determines 
whether or not the current partial image is to be recorded 
based upon the amount of overlap calculated by the 
overlapping amount calculating unit. 

The image input apparatus according to still another 
aspect of the present invention comprises an image pickup 
unit which optically scans a subject and thereby successively 
acquires plural images of the subject that are partial images 
of the sub j ect having overlapping portions , wherein the image 
pickup unit obtains the partial images by moving in a plane 
that is parallel to aplane of the subject and without touching 
the subject; an orientation detection unit which detects 
an orientation of the image pickup unit based upon rotation 
angular velocities around two axes that are virtually 
parallel with an optic axis of said image pickup unit and 
mutually perpendicular to each to other between a time when 
a previous partial image was taken and a time when a current 
partial image is being taken; a relative change detection 
unit which detects an amount of relative change in position 
or speed of the image pickup unit between a time when a previous 
partial image was taken and a time when a current partial 
image is being taken; an overlapping amount calculating unit 
which calculates an amount of overlap between the partial 
images taken at the previous input time and the partial images 



taken at the current input time based upon the amount of 
relative change in position or speed detectedby the relative 
change detection unit and the orientation detected by the 
orientation detection unit; and an image recording 
determination unit which determines whether or not the 
current partial image is to be recorded based upon the amount 
of overlap calculated by the overlapping amount calculating 
unit . 

The image input apparatus according to still another 
aspect of the present invention comprises an image pickup 
unit which optically scans a sub j ect and thereby successively 
acquires plural images of the sub j ect that are partial images 
of the subject having overlapping portions , wherein the image 
pickup unit obtains the partial images by moving in a plane 
that is parallel to a plane of the subj ect and without touching 
the subject; aplurality of line sensors each of which detects 
an amount of shift of the image pickup unit in the horizontal 
direction and in the vertical direction; an overlapping 
amount calculating unit which determines an amount of shift 
from input waveforms of the line sensors between the previous 
partial image and the current partial image, and calculates 
an amount of overlap between the previous partial image and 
the current partial image based upon the amount of shift; 
and an image recording determination unit which determines 
whether or not the current partial image is to be recorded 



based upon the amount of overlap calculated by the 
overlapping amount calculating unit. 

The image input apparatus according to still another 
aspect of the present invention comprises a first image 
pickup unit which optically scans a subject and thereby 
acquires plural images of the subject that are partial images 
of the subject, wherein said image pickup unit obtains the 
partial images by moving in a plane that is parallel to a 
plane of the subject and without touching the subject; a 
second image pickup unit which continuously picks up the 
image that is being scanned; an overlapping amount 
calculating unit which calculates an amount of overlap 
between the partial images picked up by the first image pickup 
unit based upon the image picked up by the second image pickup 
unit; and an image recording determination unit which 
determines whether or not the current partial image is to 
be recorded based upon the amount of overlap calculated by 
the overlapping amount calculating unit. 

The image input apparatus according to still another 
aspect of the present invention comprises an image pickup 
unitwhich optically scans a subject and thereby successively 
acquires plural images of the subj ect that are partial images 
of the subj ect having overlapping portions , wherein the image 
pickup unit obtains the partial images by moving in a plane 
that is parallel to a plane of the subj ect and without touching 
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the subject; a timer which counts time that has elapsed time 
from when the previous partial image was acquired; and an 
image recording determination unit which determines whether 
or not the current partial image is to be recorded based 
on the time counted by the timer. 

Other objects and features of this invention will 
become apparent from the following description with 
reference to the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram that shows a basic structure 
of an image input apparatus in accordance with an embodiment 
of the present invention; 

Fig. 2 is a flow chart that shows operations and 
processes from an image pickup to a composing process; 

Fig. 3 is an explanatory drawing that shows a state 
of an image pickup operation by the image input apparatus; 

Fig. 4A to Fig. 4D are explanatory drawings that show 
states of an image to be picked up; 

Fig. 5 is a flow chart showing a sequence of composing 
processes of partial images in accordance with an embodiment 
of the present invention; 

Fig. 6A and Fig. 6B are explanatory drawings that show 
an example of extracted points corresponding to featuring 
points of partial images P(l), P(2) and P(l); 



Fig. 7A to Fig. 7C are explanatory drawings that show 
a sequence of composing processes of the partial images; 

Fig. 8 is a block diagram that shows a construction 
of an image input apparatus in accordance with a first 
embodiment of the present invention; 

Fig. 9 is an explanatory drawing that shows an example 
of detection of an amount of overlap in the image input 
apparatus in accordance with the first embodiment of the 
present invention; 

Fig. 10 is a block diagram that shows a construction 
of an image input apparatus in accordance with a second 
embodiment of the present invention; 

Fig . 11 is an explanatory drawing that shows an example 
of detection of an amount of overlap in the image input 
apparatus in accordance with the second embodiment of the 
present invention; 

Fig. 12 is a block diagram that shows a construction 
of an image input apparatus in accordance with a third 
embodiment of the present invention; 

Fig. 13 is an explanatory drawing that shows an example 
of detection of an amount of overlap in the image input 
apparatus in accordance with the third embodiment of the 
present invention; 

Fig. 14 , which relates to a fourth embodiment, is an 
explanatory drawing that shows an example of detection of 



an amount of overlap in the image input apparatus having 
a structure of Fig. 8, 10 or 12 to which a distance measuring 
sensor is added; 

Fig. 15 is a block diagram that shows a construction 
of an image input apparatus in accordance with the sixth 
embodiment of the present invention; 

Fig. 16 is an explanatory drawing that shows adetection 
state at the time t and the time t + At in a line sensor 
in accordance with the sixth embodiment of the present 
invention; 

Fig. 17 is a block diagram that shows a construction 
of an image input apparatus in accordance with a seventh 
embodiment of the present invention; 

Fig. 18 is an explanatory drawing that shows an example 
of an acquired image by a high speed area sensor in accordance 
with the seventh embodiment of the present invention; 

Fig. 19 is a block diagram that shows a construction 
of an image input apparatus in accordance with a eighth 
embodiment of the present invention; and 

Fig. 20 is a block diagram that shows a construction 
of a conventional image input apparatus. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Embodiments of an image input apparatus according to 
the present invention have been explained below with 



reference to the accompanying drawings. However, the 
present invention is not intended to be limited by these 
embodiments . 

Fig. 1 is a block diagram that shows a basic structure 
of an image input apparatus in accordance with the present 
embodiment . In this Figure, reference number 10 represents 
a lens for taking a subject image and for converging it on 
an image pickup element, reference number 11 is an image 
pickup element, constituted by CCDs, etc., for obtaining 
an image signal of the subject image that has been converged 
by the lens 10, reference number 12 is an A/D converter for 
converting the image signal (analog value) sent from the 
image pickup element 11 to a digital signal, reference number 
13 is an MPU for carrying out various correcting operations 
and compressing operations on the image signal that has been 
converted to a digital value by the A/D converter 12, 
reference number 14 is an image memory for storing the image 
that has been processed by the MPU 13, reference number 15 
represents a display apparatus which is constituted by 
display panels made from LCD, and which displays images 
immediately before they are stored and images that have been 
stored in the image memory 14, reference number 16 is an 
operation section for carrying out an image pickup operation 
and for turning the power supply ON/ OFF, and reference number 
17 is a switch used for picking up an image . Here, in addition 



to the above mentioned constituent elements, other elements, 
such as a focusing use distance measuring sensor, a setting 
mechanism for the zoom magni f ication and setting mechanisms 
for various modes, may be installed. 

Operation of the image input apparatus will be 
explained now. Fig. 2 is a flow chart that shows operations 
and processes from an image pickup process to a composing 
process . Fig . 3 is an explanatory drawing that shows a state 
in which the image pickup process is carried out by the image 
input apparatus . Fig. 4AtoFig. 4D are explanatory drawings 
that show states of an image to be picked up. 

First, as illustrated in Fig. 3, the operator holds 
the image input apparatus 21 with the hand, turns the switch 
17 ON (step Sll), and carries out a non contact scanning 
operation over a subject 20 to be inputted as image 
information, such as a document, a paper face, and a panel, 
with the switch 17 being kept ON. During this scanning 
operation, partial images, which correspond to a plurality 
of images obtained by dividing the subject image in a 
predetermined synchronized timing, arepickedup (StepS12) . 
Thereafter, the switch 17 is turned OFF (step S13), and a 
composing operation is carried out (step S14) . 

In other words, when, for example, images have been 
picked up in the order of images shown in Fig. 4A to Fig. 
4D during the image pickup operation, these images are 
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composed so that the entire image or a required portion of 
the subject 20 is generated as a sheet of image covering 
a wide range with high precision in the same manner as the 
subject 20. Here, this image composing process may be 
executed in the image input apparatus 21 main body, or the 
partial images may be transferred to a computer, etc., and 
the process may be executed in the personal computer. 
Moreover, the operation method for the image pickup is not 
intended to be limited by the above embodiment; and, for 
example, without installing the switch 17, the image pickup 
operation may be automatically started at the time when the 
scanning is started. 

Next, an explanation will be given on the composing 
method of the partial images. Fig. 5 is a flow chart that 
shows a sequence of the composing processes of the partial 
images in accordance with the present embodiment of the 
invention. Fig. 6A and Fig. 6B are explanatory drawings 
that show an example of extracting points that correspond 
to feature points of the partial images P (1) , P (2 ) and P (1) . 

Here, supposing that eachpartial image is represented 
by P (i) (i = 1 to N) , and that the total number of the partial 
images is represented by N. First, as illustrated in Fig. 
6A, partial image P(l), i = 1/ is loaded (step S21) , and 
featuring points are automatically extracted from partial 
image P(l) (stepS22). At this time, supposing that partial 



image P (1) is in a state as shown in Fig. 6A, it is preferable 
to extract corner portions 60 to 66 as indicated by circled 
portions as the featuring points . The features of this type 
may be extracted by using a differential filter, etc. 

Successively, partial image P(2), (i + 1), adjacent 
to partial image P(l), is loaded (step S23), and points 
corresponding to the featuring points P(l) are extracted 
(step S24) . When this partial image P(2) is represented 
by Fig. 6B, points 60' to 66' corresponding to the featuring 
points 60 to 66 are extracted. The corresponding point 
extracting process of this type is carried out by finding 
correlated values on P(2) within a smaller image area 
centered on each featuring point on P (1) , and the area which 
makes the correlated values maximum is found so that the 
center of the area is extracted as a corresponding point. 

Successively, a projection conversion parameter, 
which will be described later, is calculated (step S25), 
and P(l) and P(2) are composed to one sheet of image (step 
S26) based upon the featuring points and the corresponding 
points. The following description will discuss an example 
of the composing process of these two images. 

Here, suppose that coordinates of a point on P(l) are 
represented by (x, y) , and corresponding coordinates on P (2 ) 
are represented by (x' , y' ) . When the subject is a plane 
surface, such as a paper face and a wall, or an object located 
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far away, the following relationship (1) holds. 

_ hO • x T +hl - y r +h2 
X ~ h6 • x T +h7 * y T +l (1) 

h3 * x T +h4 • y'+h5 
Y " h6 • x T +h7 • y T +l 

Here, hO to h7 in equation (1), which are referred 
to as projection conversion parameters, are inherent 
5 constant values between the two images. Therefore, when 
there are not less than four pairs of a featuring point and 
a corresponding point, these projection conversion 
parameters are determined. In general, since an image 
contains noise, several tens of pairs are used, and the least 
10 square method is used to calculate the projection conversion 
parameters . 

After the projection conversion parameters have been 
calculated in this manner, calculations are carried out by 
using the above mentioned equation (1) as to which positions 

15 on P(l) all the pixels on P(2) are arranged. Thus, P(l) 
and P(2) are combined into one sheet of image (this is newly 
referred to as P(l)). The above mentioned calculating 
processes are repeatedly executed until all the partial 
images have been composed to form one sheet of image. In 

20 other words, i is incremented one by one (step S27), and 
the same process is carried out until i has reached N (see 
step S28) . 

In other words, in case of the partial images shown 



in Fig. 4A to Fig. 4D, as illustrated in Fig. 7A to Fig. 
7C, four images are successively generated, and one sheet 
of composite image is then generated so that it is possible 
to generate an image with high precision that covers a wide 
5 range . 

Next, referring to specific examples, an explanation 
will be given of the operation and construction of a apparatus 
for picking partial images up in predetermined synchronized 
timing, in order to maintain a proper amount of an overlapping 

10 area between the partial images. 

Fig. 8 is a block diagram that shows the construction 
of an image input apparatus in accordance with the first 
embodiment of the present invention. In this Figure, 
reference number 3 0 represents a relative position detection 

15 section for detecting relative positions between a certain 
period of time in the image input apparatus, reference number 
31 represents an overlapping amount calculation section for 
detecting the amount of overlap (overlapped area) between 
partial images from the detected value of the relative 

20 position detection section 30, and reference number 32 
represents an image recording determination section for 
determining whether or not the current partial image is 
recordable based upon the amount of overlap calculated by 
the overlapping amount calculation section 31. Here, the 
25 other constituent elements are the same as those shown in 



Fig. 1; therefore, the same reference numbers are used, and 
the description thereof is omitted. 

The relative position detection section 30 is 
constituted by, for example, an acceleration sensor for 
detecting accelerations orthogonal to each other in a 
direction virtually parallel to an image pickup face and 
an integral circuit. With respect to the acceleration 
censor, for example, an inexpensive, small size 
piezoelectric acceleration censor is used. 

In this case, supposing that the time at which a partial 
image was picked up previously is t, the relative position 
detection section 30 makes it possible to detect a relative 

position at the current time t + At from the time t. When 
the relative position is detected from the value of 
acceleration, integrations are carried out twice; however, 
an integration constant (initial acceleration) is not 
determined. Here, since it is supposed that, upon starting 
an image pickup operation, the acceleration is zero, the 
calculations are carried out assuming that the integration 
constant is zero. 

Fig. 9 is an explanatory drawing that shows an example 
of the detection of the amount of overlap in the image input 
apparatus in accordance with the first embodiment of the 
present invention. In Fig. 9, reference number 40 
represents an image input apparatus including the functional 
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elements shown in Fig. 8, and reference number 41 is a surface 
of a subject. 

Suppose that the relative position of the image input 
apparatus 40 is displaced by dx in the x direction . Moreover, 
suppose that the image pickup face of the image input 
apparatus 40 and the face of the subject 41 are in parallel 
with each other. Furthermore, suppose that the distance 
from the image input apparatus 40 to the face of the subject 
41 is 1 . Itis preferable to set the distance 1 to the closest 
value at the time when the operator inputs the subject. 

Supposing that the field angle of the image input 
apparatus 40 in the x direction is 2 x 9x, the length pxl 
of an area in which partial images overlap each other is 
represented by the following equation: 

pxl = 21 tan 9x - dx ... (2) 

In the same manner, in the y direction that is 
orthogonal to the x direction, and parallel to the face of 
an image, the length pyl of an area in which partial images 
overlap each other is represented by the following equation: 
pyl = 21 tan 9y - dy ... (3) 

Here, it is assumed that the relative displacement 
of the image input apparatus 40 in the y direction is dy, 
and that the field angle in the y direction is 2 x 6x. The 
overlapping amount calculation section 31 carries out 
calculations of pxl and pyl- 



Thereafter, pxl and pyl, thus calculated, are compared 
with predetermined threshold values tx and ty in the image 
recording determination section 32. At this time, when the 
following inequality is satisfied, an image recording signal 
5 is transmitted to MPU 13, and an image pickup operation is 
carried out: 

pxl < tx or pyl < ty 
When an image has been picked up, based upon this position 
as a reference, pxl and pyl are calculated so as to newly 

10 pick up the next image adjacent thereto, and a judgment is 
made as to whether or not the image recording is operable. 
Additionally, the above mentioned overlapping amount 
calculation section 31 and the image recording determination 
section 32 may be realized by software in the MPU 13. 

15 Therefore, in accordance with the first embodiment, 

the relative position detection section 30 detects at least 
a directional component in parallel with the image pickup 
face of a relative position of the image input apparatus; 
the overlapping amount calculation section 31 calculates 

20 the amount of overlap of a partial image that is being 
currently scanned and is to be inputted by the image input 
apparatus with respect to at least one partial image that 
has been inputted before, based upon orientation detection 
values and shifting velocities; and the image recording 

25 determination section 32 determines whether or not the 



current partial image is recordable based upon the amount 
of overlap. Thus, in comparison with a conventional 
arrangement in which positional orientation detections of 
6 degrees of freedom are carried out on a subject, it is 
5 possible to obtain the amount of overlap required at the 
time of image composition by using a smaller, inexpensive 
arrangement . 

Fig- 10 is a block diagram that shows the construction 
of an image input apparatus in accordance with the second 

10 embodiment of the present invention. In this Figure, 
reference number 50 represents an angle detection section 
for detecting a change in angles between a certain period 
of time in the image input apparatus, reference number 51 
represents an overlapping amount calculation section for 

15 detecting the amount of overlap (overlapped area) between 
partial images from the detected value of the angle detection 
section 50, and reference number 52 represents an image 
recording determination section for determining whether or 
not the current partial image is recordable based upon the 

20 amount of overlap calculated by the overlapping amount 
calculation section 51. Here, the other constituent 
elements are the same as those shown in Fig. 1; therefore, 
the same reference numbers are used, and the description 
thereof is omitted. 

25 The angle detection section 50 is constituted by, for 
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example, a gyro sensor for detecting rotation angular 
velocities around two axes that are orthogonal to each other 
in a direction virtually parallel to an image pickup face 
and an integral circuit. With respect to the gyro sensor, 
5 for example, a pie zoelectric vibration sensor , which detects 
a movement of an object based upon Coriolis force, converts 
vibration of a right triangle pole to a vibration torque 
equal to the number of oscillations of a tuning fork, and 
obtains a rotation angular velocity as an amount of change 
10 in voltage, is used. When the change in angles is detected 
from the angular velocities, an integration is carried out 
once. Supposing that the time at which a partial image was 
picked up previously is t, the angle detection section 50 
makes it possible to detect a change in angles at the current 

15 time t + At from the time t. 

In addition to this, another arrangement may be used 
in which an absolute angle is detected by using an 
acceleration sensor and a magnetic sensor so as to calculate 
the change in angles. With respect to the magnetic sensor, 

20 elements, such as a semiconductor hole element, a 
semiconductor magnetic resistance element, a magnetic body 
magnetic resistance element and a magnetic induction type 
magnetic sensor, may be used. 

Fig . 11 is an explanatory drawing that shows an example 

25 of the detection of the amount of overlap in the image input 



apparatus in accordance with the second embodiment of the 
present invention. In this Figure, reference number 70 
represents an image input apparatus arranged as illustrated 
in Fig . 10 , and reference number 71 is a surface of a subject. 
5 Here, suppose that the image input apparatus 70 has 

an angular change by <|>y around the y axis. Moreover, it 
is supposed that the x axis and y axis are axes that are 
in parallel with the image pickup face, and are orthogonal 
to each other while passing through the optical center of 

10 the image input apparatus 70. Furthermore, suppose that 
the distance from the image input apparatus 70 to the face 
of the subject 71 is 1, and that, in relation to the position 
of the image input apparatus 70 at the time t, a relative 
position thereof at the time t + At is represented by (ex, 

15 ey) . It is preferable to set the distance 1 to the closest 
value at the time when the operator inputs the subject, or 
(ex, ey) may be set to (0, 0) . 

Supposing that the field angle of the image input 
apparatus 70 in the x direction is 2 x 9x, the length px2 

20 in the x direction of an area in which partial images overlap 
each other is represented by the following equation: 
px2 = 1 tan 0x + 1 tan (8x + (f>y) - ex ...(4) 
In the same manner, the length py2 of an area in which 
partial images overlap each other is represented by the 

25 following equation: 



py2 - 1 tan 9y + 1 tan(0y + <])x) - ey ...(5) 
Here, the field angle in the y direction of the image 
input apparatus 70 is set to 2 x 9y. Calculations on these 
px2 and py2 are carried out in the overlapping amount 
calculation section 51 . 

Thereafter, px2andpy2, thus calculated, are compared 
with predetermined threshold values tx and ty in the image 
recording determination section 52 . At this time, when the 
following inequality is satisfied, an image recording signal 
is transmitted to MPU 13, and an image pickup operation is 
carried out: 

Px2 < tx or py2 < ty 

When an image has been picked up, based upon this 
position as a reference, px2 and py2 are again calculated 
so as to newly pick up the next image adjacent thereto, and 
a judgment is made as to whether or not the image recording 
is operable . Additionally, the above mentioned overlapping 
amount calculation section 51 and the image recording 
determination section 52 may be realized by software in the 
MPU 13- Moreover, in this embodiment, it is assumed that 
the image pickup face of the image input apparatus 70 and 
the face of the subject 71 are in parallel with each other 
at time t; however, it may be assumed that they are in parallel 
with each other at the time when the initial partial image 
P (1) is picked up, and a change in angles may be calculated. 



Therefore, in accordance with the second embodiment, 
the angle detection section 50 detects at least components 
around the two axes that are orthogonal to the light axis 
and are virtually orthogonal to each other of the rotation 
angle of the image input apparatus 70; the overlapping amount 
calculation section 51 calculates the amount of overlap of 
a partial image that is being currently scanned and is to 
be inputted by the image input apparatus 70 with respect 
to at least one partial image that has been inputted before, 
based upon the angular velocities; and the image recording 
determination section 52 determines whether or not the 
current partial image is recordable based upon the amount 
of overlap. Thus, even in the case of a great rotation by 
the user and in the service environments, it is possible 
for the image input apparatus to obtain the amount of overlap 
required at the time of image composition by using a smaller, 
inexpensive arrangement, as compared with a conventional 
apparatus . 

Fig. 12 is a block diagram that shows the construction 
of an image input apparatus in accordance with the third 
embodiment of the present invention. In this Figure, 
reference number 80 represents an angle detection section 
for detecting a change in orientation angles between a 
certain period of time in the image input apparatus, 
reference number 81 represents a relative position detection 



section for detecting a relative position of the image input 
apparatus between a certain period of time, reference number 
82 represents an overlapping amount calculation section for 
detecting the amount of overlap (overlapped area) between 
5 partial images from the detected value of the angle detection 
section 80 or the detected value of the relative positional 
detection section 81, and reference number 83 represents 
an image recording determination section for determining 
whether or not the current partial image is recordable based 

10 upon the amount of overlap calculated by the overlapping 
amount calculation section 82. Here, the other constituent 
elements are the same as those shown in Fig. 1; therefore, 
the same reference numbers are used, and the description 
thereof is omitted. 

15 The angle detection section 80 is constituted by, for 

example, a gyro sensor for detecting rotation angular 
velocities around two axes that are orthogonal to each other 
in a direction virtually parallel to an image pickup face, 
and an integral circuit. When the change in angles is 

20 detected from the angular velocities, an integration is 
carried out once. The relative position detection section 
81 is constituted by, for example, an acceleration sensor 
for detecting accelerations that are orthogonal to each other 
in a direction virtually parallel to the image pickup face, 

25 and an integral circuit. 



When the relative position is detected from the value 
of acceleration, integrations are carried out twice; however, 
an integration constant (initial acceleration) is not 
determined. Here, since it is supposed that, upon starting 
an image pickup operation, the acceleration is zero, the 
calculations are carried out assuming that the integration 
constant is zero. Moreover, a gravity component is mixed 
into the value of acceleration. However, supposing that 
the acceleration by the scanning upon starting an image 
pickup operation is 0, the value of acceleration at this 
time is exerted by gravity. 

Here, supposing that time 0 is the starting time of 
an image pickup operation, the value of the acceleration 
sensor is represented by the following expression: 

gx 

gy 

Next, the value obtained by the acceleration sensor 
at the time t is represented by the following expression: 

ax 
ay 
az 

The angle detection section 80 makes it possible to 
detect a change in rotation angles at the time t in relation 
to the time 0 . Supposing that this three axes rotationmatrix 



is represented by R, the direction of gravity at the time 
t is represented by the following expression: 
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Here, the acceleration component by the scanning at 
5 the time t is represented by the following expression: 



ax 
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ay 
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Based upon the above mentioned expressions, supposing 
that the time at which a partial image was picked up previously 
is t, the relative position and the change in angles at the 
current time t + At in relation to the time t can be detected. 

Fig. 13 is an explanatory drawing that shows an example 
of the detection of the amount of overlap in the image input 
apparatus in accordance with the third embodiment of the 
present invention. In this Figure, reference number 90 
represents an image input apparatus arranged as illustrated 
in Fig . 12 , and reference number 91 is a surface of a subject. 

Suppose that the image input apparatus 90 has an angular 
change by c|>y around the y axis. Moreover, suppose that the 
relative position of the image input apparatus 90 is 
represented by (dx, dy, dz) . Here, it is supposed that the 
x axis and y axis are axes that are in parallel with the 
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image pickup face, and are orthogonal to each other while 
passing through the optical center of the image input 
apparatus 90. Moreover, it is supposed that at the time 
t, the image pickup face of the image input apparatus 90 
5 and the face of the subject 91 are in parallel with each 
other at the time t. Furthermore, suppose that the distance 
from the image input apparatus 90 to the face of the subject 
is 1. The distance 1 is preferably set to the closest value 
at the time when the operator inputs the subject. 

10 Supposing that the field angle of the image input 

apparatus 90 in the x direction is 2 x 0x, the length px3 
in the x direction of an area in which partial images overlap 
each other is represented by equation (6): 

px3 - 1 tan 9x + 1 tan(9x + (j>y) - dx ...(6) 

15 In the same manner, the length py3 of an area in which 

partial images overlap each other is represented by equation 
(7) : 

py3 = 1 tan 9y + 1 tan(9y + (J)x) - dy ...(7) 
Here, the field angle in the y direction of the image 
20 input apparatus 90 is set to 2 x 9y. Calculations on these 
px3 and py3 are carried out in the overlapping amount 
calculation section 82. Thereafter, px3 and py3, thus 
calculated, are compared with predetermined threshold 
values tx and ty in the image recording determination section 
25 83 . At this time , when the following inequality is satisfied, 
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an image recording signal is transmitted to MPU 13, and an 
image pickup operation is carried out: 
px3 < tx or py3 < ty 

When an image has been picked up, based upon this 
5 position as a reference, px2 and py2 are again calculated 
so as to newly pick up the next image adjacent thereto, and 
a judgment is made as to whether or not the image recording 
is operable . Additionally, the above mentioned overlapping 
amount calculation section 82 and the image recording 

10 determination section 83 may be realized by software in the 
MPU 13. Moreover, in this embodiment, it is assumed that 
the image pickup face of the image input apparatus 90 and 
the face of the subject 91 are in parallel with each other 
at time t ; however, it may be assumed that they are in parallel 

15 with each other at the time when the initial partial image 
P ( 1) is picked up, and a change in angles may be calculated . 

Therefore, in accordance with the third embodiment, 
the angle detection section 80 detects the orientation of 
the image input apparatus, the relative position detection 

20 section 81 detects the relative position of the image input 
apparatus so that the overlapping amount calculation section 
82 calculates the amount of overlap of a partial image that 
is being currently scanned and is to be inputted by the image 
input apparatus with respect to at least one partial image 

25 that has been inputted before, based upon the orientation 

32 



detection and the shifting velocities, and the image 
recording determination section 83 determines whether or 
not the current partial image is recordable based upon the 
amount of overlap. Thus, it is possible to realize a small 
5 size apparatus with higher reliability at low costs. 

Fourth embodiment is a case in which, in any one of 
the above mentioned first to third embodiments, a distance 
measuring sensor for measuring the distance from the subject 
in the light axis direction of the image input apparatus 

10 is installed. In other words, in the arrangement as shown 
in Fig. 8, Fig. 10 or Fig. 12, a distance measuring sensor 
is connected to the MPU 13. Fig. 14 is an explanatory drawing 
that shows an example of the detection of the amount of overlap 
in an image input apparatus 100 in which a distance measuring 

15 sensor 101 is added to the construction of Fig. 8, Fig. 10 
or Fig. 12. In this Figure , reference number 100 represents 
the image input apparatus, reference number 101 is the 
distance measuring sensor, and reference number 102 is a 
surface of a subject. 

20 With respect to the distance measuring sensor 101, 

any one of the ultrasonic wave system, the optical system 
and the eddy current system may be used. For example, an 
active system which detects scattered light of an infrared 
beam so that the distance is calculated by using the 

25 triangulation may be used, or a passive system for measuring 



the distance based upon the focal distance may be used. 
Alternatively, a function used for auto focusing may be used 
as the distance measuring sensor 101 in a combined manner. 
As illustrated in Fig. 14, suppose that the image input 
5 apparatus 100 is shifted from a position on the left to a 
position on the right. Suppose that distance information 
obtained by the distance measuring sensor 101 on the left 
position is represented by 11, and that distance information 
obtained by the distance measuring sensor 101 on the right 
10 position is represented by 12. In this case, pxl, pyl, 
described in the first embodiment, are represented by the 
following equation (8): 

pxl = (11+12) tan Ox - dx ...(8) 
pyl - (11+12) tan 0y - dy 
15 Moreover, px2, py2 , described in the second embodiment 

are represented by the following equation (9): 

px2 =11 tan Ox + 1 2 sin(9x + tyy) - ex ...(9) 
py2 = 11 tan 0y + 1 2 sin(9y + <j>x) - ey 
Furthermore, px3, py3, described in the second 
20 embodiment, are represented by the following equation (10): 
px3 = 11 tan Ox + 1 2 sin (9x + <j>y) - dx ...(10) 
py3 = 11 tan 6y + 1 2 sin (8y + §x) - dy 
Therefore, in accordance with the fourth embodiment, 
since the distance measuring sensor 101 for detecting the 
25 distance from the subject is installed in each of the image 



input apparatuses of Embodiments 1 to 3, the overlapping 
amount detection section is allowed to detect the amount 
of overlap between partial images by utilizing the distance 
information from the distance measuring sensor 101; 
5 therefore, it becomes possible to maintain an overlapping 
area required upon image composition more accurately. 

Fifth embodiment is a case in which, in any one of 
the above mentioned first to fourth embodiments, an 
inclination of a subject is detected, and this is utilized 

O 

jfl 10 for the calculations on the amount of overlap. When the 

inclination of the subject is detected, distance measuring 
sensors, which measure distances to the subject in at least 

y three directions that are not parallel to each other from 

Q 

S the image input apparatus (in Fig. 14, distance measuring 

]p : 15 sensors 101 are placed in three directions that are not 

I-* parallel to each other) , are installed. In this case, when 

the distances at least in the three directions are found, 
normal vectors (a, b, c) of the face of the subject with 
respect to the image input apparatus can be calculated. 
20 Supposing that axes that are orthogonal to each other 

in parallel with the face of the subject are x axis and y 
axis, the inclination of the image input apparatus with 
respect to the subject, that is, the rotation angles cpx, 
(py around the x axis and y axis, are found from equation 
25 (11) : 
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a 2 + c 2 ... (11) 

-i a 

cpy = tan — 
b 

Based upon the above mentioned equations, equations 
(8) to (10) are respectively represented by equations (12) 
to (14) : 

pxl = (11 + 12) tan(9x + cpy) - dx 
pyl = (11 + 12) tan(0y + cpx) - dy ...(12) 
px2 = 11 tan (9x+cpy) +12 sin (9x+cpy+cby ) -ex 
py2 = 11 tan (9y+cpx) +12 sin (9y+cpx+ct)x) -ey ...(13) 
px3 = 11 tan (0x+cpy) +12 sin (9x+cpy+cJ>y ) -dx 
py3 = 11 tan (9y+cpx) +12 sin (9y+cpx+cj>x) -dy ...(14) 
Therefore, in accordance with the fifth embodiment, 
since, in Embodiments 1 to 3, the distance from the subject 
is detected so that the overlapping amount detection section 
calculates the amount of overlap by utilizing this distance, 
not only information of the position orientation on the image 
input apparatus side, but also information of the orientation 
of the subject can be inputted; therefore, it becomes 
possible to maintain an overlapping area required upon image 
composition more accurately. 

Fig. 15 is a block diagram that shows the construction 
of an image input apparatus in accordance with a sixth 
embodiment of the present invention. In this Figure, 
reference number 110 represents a line sensor that measures 



the amount of shift of the subject in the vertical direction, 
reference number 111 represents a line sensor that measures 
the amount of shift of the sub j ect in the horizontal direction, 
reference number 112 is an overlapping amount calculation 
section for calculating the amount of overlap between partial 
images from the output values of the line sensors 110, 111, 
and reference number 113 is an image recording determination 
section for determining whether or not the current partial 
image is recordable based upon the amount of overlap 
calculated by the overlapping amount calculation section 
112. Here, the other constituent elements are the same as 
those shown in Fig. 1; therefore, the same reference numbers 
are used, and the description thereof is omitted. 

In this manner, the line sensor 110 and the line sensor 
111 are placed in a manner so as to be virtually orthogonal 
to each other. Fig. 16 is an explanatory drawing that 
explains the output relationship of the line sensors at the 
time t and the time t + At . Based upon input waveforms of 
the line sensors 110, 111 at the time t in which a partial 
image was picked up previously and input waveforms at the 
current time t + At, the overlapping amount calculation 
section 112 calculates the amount of shift of the partial 
image. Here, the respective amounts of shifts of the line 
sensors 110, 111 are represented by px, py. The amounts 
of shifts are compared with predetermined threshold values 



tx, ty in the image recording determination section 113. 

When the results of the comparison in the image 
recording determination section 113 satisfy the following 
inequality, an image recording signal is transmitted to MPU 
13, and an image pickup operation of a partial image is carried 
out : 

px < tx or py < ty 
When the partial image has been picked up, based upon the 
respective values of the line sensors 110, 111 at this 
position as a reference, px and py are again calculated by 
the overlapping amount calculation section 112 so as to newly 
pick up the next partial image adjacent thereto, and a 
judgment ismade by the image recording determination section 
113 as to whether or not the image recording is operable. 
Additionally, the above mentioned overlapping amount 
calculation section 112 and the image recording 
determination section 113 may be realized by software in 
the MPU 13. 

In this manner, the line sensors 110, 111 that are 
orthogonal to each other are placed, and the amount of overlap 
of a partial image that is being currently scanned and is 
to be inputted by the image input apparatus with respect 
to at least one partial image that has been inputted before 
is calculated from the amounts of shifts of the line sensors 
110, 111, so as to determine whether or not the current partial 
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image is recordable; therefore, this arrangement makes it 
possible to eliminate the necessity of carrying out the 
detection of the orientation and the detection of shifting 
speed of the image input apparatus, which are not stable 
in precision and reliability. 

Fig. 17 is a block diagram that shows the construction 
of an image input apparatus in accordance with the seventh 
embodiment of the present invention. In this Figure, 
reference number 120 represents a high speed area sensor 
that acquires an image virtually in the same area as the 
image pickup element 11 at high speeds, reference number 
121 represents an overlapping amount calculation section 
for calculating the amount of overlap of the partial image 
that has been acquired by the high speed area sensor 120, 
and reference number 122 is an image recording determination 
section for determining whether or not the current partial 
image is recordable based upon the amount of overlap 
calculated by the overlapping amount calculation section 
121. Here, the other constituent elements are the same as 
those shown in Fig. 1; therefore, the same reference numbers 
are used, and the description thereof is omitted. 

In the above mentioned arrangement, first, the high 
speed area sensor 120 inputs an image within virtually the 
same area as the image pickup element 11. Then, the 
overlapping amount calculation section 121 calculates the 



amount of overlap between the input image to the high speed 
area sensor 120 at the time t when the partial image was 
previously acquired and an input image to the high speed 
area sensor 120 at the current time t + At. 

In the calculation method of the amount of overlap, 
a mutual correlation is found between the two images, and 
the size of the overlapping area between the two is found 
based upon positions at which the maximum values have been 
reached. For example, as illustrated in Fig. 18, when the 
calculation makes a judgment that the acquired image at the 
time t and the acquired image at the time t + At overlap 
each other, px, py are found. Then, these values are compared 
with predetermined threshold values tx, ty in the image 
recording determination section 122. 

When the results of the comparison in the image 
recording determination section 122 satisfy the following 
inequality, an image recording signal is transmitted to MPU 
13, and an image pickup operation of a partial image is carried 
out : 

px < tx or py < ty 
When the partial image has been picked up, based upon the 
respective values of the line sensors 110, 111 at this 
position as a reference, px and py are again calculated by 
the overlapping amount calculation section 121 so as to newly 
pick up the next partial image adjacent thereto, and a 
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judgment ismade by the image recording determination section 
122 as to whether or not the image recording is operable. 
Additionally, the above mentioned overlapping amount 
calculation section 121 and the image recording 
determination section 122 may be realized by software in 
the MPU 13. 

In this manner, the high speed area sensor 120 that 
successively acquires an image being scanned is placed, and 
the amount of overlap of a partial image that is being 
currently scanned and is to be inputted by the image pickup 
element 11 of the image input apparatus with respect to at 
least one partial image that has been acquired by the high 
speed area sensor 120 so as to determine whether or not the 
current partial image is recordable; therefore, this 
arrangement makes it possible to eliminate the necessity 
of carrying out the detection of the orientation and the 
detection of shifting speed of the image input apparatus, 
which are not stable in precision and reliability. Moreover, 
the high speed area sensor 120, used for detecting the amount 
of overlap, is installed in a separated manner from the image 
pickup element 11 used for picking up divided images; thus, 
selective modes are achieved in which the normal image pickup 
element 11 is used for picking up divided images requiring 
high resolution, while, in contrast, the high speed area 
sensor 120 having high speeds although the number of pixels 



is small is used for acquiring images used for overlapping 
amount calculations that require high speed reading. 
Therefore, it is possible to achieve an apparatus that is 
more inexpensive and has higher performances/ as compared 
5 with conventional apparatuses. 

Fig. 19 is a block diagram that shows the construction 
of an image input apparatus in accordance with the eighth 
embodiment of the present invention. In this Figure, 
reference number 130 represents a timer that counts time 

10 from the image pickup time of the previous partial image, 
and reference number 131 is an image recording determination 
section for determining whether or not the current partial 
image is recordable based upon the counted time by the timer 
130. Here, the other constituent elements are the same as 

15 those shown in Fig. 1; therefore, the same reference numbers 
are used, and the description thereof is omitted. 

In the above mentioned arrangement, first, the timer 
130 counts a period of time that has elapsed from the input 
time at which the previous partial image was acquired . Then, 

20 the counted time is compared with a predetermined threshold 
value in the image recording determination section 131. As 
a result of the comparison, when the counted time exceeds 
the predetermined threshold value, an image recording signal 
is transmitted to MPU 13, and an image pickup operation of 

25 a partial image is carried out. When the partial image has 
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been picked up, the time counting is resumed after the timer 
130 has been reset, and a judgment is made as to whether 
or not the image recording is operable. This operation may 
be added to any one of the image input apparatuses described 
in the aforementioned Embodiments 1 to 7 . In this case, 
even when the input condition of the partial image in each 
of the Embodiments is not satisfied, the image acquiring 
may be carried out, when the counted time has exceeded the 
above mentioned threshold value . Here, the image recording 
determination section 131 may be realized by software in 
the MPU 13. 

In this manner, the timer 130 for counting a period 
of elapsed time from the previous image input is installed, 
and when the elapsed time by the timer 130 has exceeded a 
predetermined value, the current partial image is acquired; 
therefore, this arrangement makes it possible to carry out 
input the partial image while maintaining the amount of 
overlap of the partial image so that it becomes possible 
to achieve a small size apparatus at low costs. 

As described above, according to one aspect of the 
present invention, in the image input apparatus, when an 
image pickup unit is shifted so as to scan, at least direction 
components in parallel with the image pickup face are 
detected as relative positions before and after the shift, 
the amount of overlap between a partial image that was 



previously picked up and the partial image currently picked 
up is calculated by using the direction components, and when 
the result of the calculation is smaller than a predetermined 
value, the current partial image is recorded, while the 
amount of overlap is greater than the above mentioned value, 
it is not recorded. Therefore, it is possible to obtain 
a sufficient amount of overlap required at the time of image 
composition, and in comparison with a conventional 
arrangement in which positional orientation detections of 
6 degrees of freedom are carried out on a subject, a simpler 
arrangement is achieved by detecting only information 
related to relative positions. As a result, it is possible 
to provide a small size image input apparatus at low costs. 

According to another aspect of the present invention, 
in the image input apparatus, when an image pickup unit is 
shifted so as to scan, at least components around two axes 
that are virtually orthogonal to the light axis of the image 
pickup unit are detected as a change in angles after the 
shift, the amount of overlap between a partial image that 
was previously picked up and the partial image currently 
picked up is calculated by using the direction components, 
and when the result of the calculation is smaller than a 
predetermined value, the current partial image is recorded, 
while the amount of overlap is greater than the above 
mentioned value, it is not recorded. Therefore, even in 



the case of a great rotation by the user and in the service 
environments, it is possible to obtain a sufficient amount 
of overlap required at the time of image composition, and 
in comparison with a conventional arrangement in which 
positional orientation detections of 6 degrees of freedom 
are carried out on a subject, a simpler arrangement is 
achieved by detecting information of rotation angle of the 
image pickup unit. As a result, it is possible to provide 
a small size image input apparatus at low costs. 

According to still another aspect of the present 
invention, in the image input apparatus, when an image pickup 
unit is shifted so as to scan, information of a change in 
angles or a relative position after the shift is obtained, 
the amount of overlap between a partial image that was 
previously picked up and the partial image currently picked 
up is calculated by using the direction components, and when 
the result of the calculation is smaller than a predetermined 
value, the current partial image is recorded, while the 
amount of overlap is greater than the above mentioned value, 
it is not recorded. Therefore, in the same manner as the 
third aspect of the present invention, even in the case of 
a great rotation by the user and in the service environments, 
it is possible to obtain a sufficient amount of overlap 
required at the time of image composition, and in comparison 
with a conventional arrangement in which positional 



orientation detections of 6 degrees of freedom are carried 
out on a subject, a simpler arrangement is achieved by 
detecting information of a change in angles or a relative 
position after the shift. As a result, it is possible to 
provide a small size image input apparatus at low costs. 

Furthermore, a distance detection unit using a 
distance measuring sensor detects the distance between the 
sub j ect and the image pickup unit, and the resulting detected 
value is added to parameters for calculating the amount of 
overlap in any one of the first to third aspects of the present 
invention so that the amount of overlap of the partial images 
is calculated. Therefore, with respect to the apparatuses 
of the first to third aspects of the present invention, it 
is possible to obtain a sufficient amount of overlap required 
at the time of image composition more accurately, and it 
is alsopossibleto provide a small size image input apparatus 
at low costs . 

Furthermore, an inclination of the surface of subject 
is detected, and the resulting detected value is added to 
parameters for calculating the amount of overlap in any one 
of the first to fourth aspects of the present invention so 
that the amount of overlap of the partial images is calculated 
Therefore, since the orientation information is also used, 
it becomes possible to obtain a sufficient amount of overlap 
required at the time of image composition more accurately, 
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and it is also possible to provide a small size image input 
apparatus at low costs. 

According to still another aspect of the present 
invention, in the image input apparatus, the amounts of 
5 shifts of the image pickup unit in the horizontal direction 
and the vertical direction are found by output values of 
line sensors placed at positions that are orthogonal to each 
other . Therefore, itis possible to eliminate the necessity 
of the orientation detection and the shift detection of the 

10 above mentioned aspects, and also to accurately carry out 
the detections of its orientation and position following 
the shift of the image pickup unit, from the viewpoint of 
precision and reliability. 

According to still another aspect of the present 

15 invention, in the image input apparatus, a second image 
pickup unit, for example, a high speed area sensor, is 
installed. Therefore, it is possible to eliminate the 
necessity of the orientation detection and the shift 
detection, which are unstable in precision and reliability. 

20 Moreover, an image sensor (second image pickup unit) for 
picking up images used for calculating the amount of overlap 
isinstalledina separate manner from the image sensor (first 
image pickup unit) for picking up partial images . Therefore, 
it is possible to achieve an apparatus having selectable 

25 modes at low costs, in which the first image pickup unit 



is used for images requiring high resolution while the second 
image pickup unit is used at the time of high speed image 
pickup processes . 

Furthermore, a timer counts a period of elapsed time 
from the input time of the previous partial image, and based 
upon the resulting value, the amount of overlap is calculated 
so that, even when the respective sensors fail to properly 
detect due to any problem such as noise, the information 
from the counting unit can be used. 

According to still another aspect of the present 
invention, in the image input apparatus, a timer for counting 
a period of elapsed time from the input time of the previous 
partial image is installed without a specific unit such as 
an orientation detection unit, etc., and partial images are 
inputted while maintaining an amount of overlap in accordance 
with the output value of the timer. Therefore, this 
arrangement eliminates the necessity of any specific 
detection unit, and makes it possible to achieve a small 
size image input apparatus at low costs. 

Furthermore, the image input apparatus stops to pick 
up an image when the image input apparatus has an amount 
of shift not less than a predetermined amount of shift. 
Therefore, it is possible to avoid picking up blurring images 
(unnecessary images) that tend to occur when the amount of 
shift is great. 
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The present document incorporates by reference the 
entire contents of Japanese priority document, 2000-200198 
filed in Japan on June 30 , 20 00 . 

Although the invention has been described with respect 
5 to a specific embodiment for a complete and clear disclosure, 
the appended claims are not to be thus limited but are to 
be construed as embodying all modifications and alternative 
constructions that may occur to one skilled in the art which 
fairly fall within the basic teaching herein set forth. 
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